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Amendments to the Claims; 

This listing of claims will replace all prior versions, and listings of claims in the application: 
Listing of Claims: 

1 . (Previously Presented) A method in a computer system for creating a 
composite electronic representation including presentation material information, the method 
comprising: 

scanning a paper document to generate an electronic representation of the 
document, the document including presentation material; 

extracting a visual feature from the electronic representation of the document, the 
visual feature corresponding to at least a portion of the presentation material; 

accessing recorded information including at least one of audio and visual 
information recorded during a presentation of the presentation material, and comparing the visual 
feature to the recorded information to determine a portion of the recorded information that 
matches the visual feature, whereby at least a portion of the recorded information matches a 
feature portion of the presentation material, and determining matching information for each 
matching portion of the recorded information and feature portion using a matching algorithm 
configured to map the visual feature to a portion of any of a plurality of recorded information 
that matches the feature portion; 

generating a user selectable object providing a user with access to the portion of 
the recorded information determined to match the visual feature, and inserting the user selectable 
object into the electronic representation of the document when the computer system locates a 
portion of the recorded information determined to match the visual feature, the computer system 
thus creating a composite electronic representation of the document including the user selectable 
object and metadata including the matching information, the user selectable object being placed 
in a position associated with the extracted feature and allowing the user to access the portion of 
the recorded information as an embedded video link in the user selectable object by selecting the 
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user selectable object, the user-selectable object being able to access the portion of the recorded 
information using the metadata in the composite document; and 

storing the composite electronic representation as a PDF, Hypertext Transfer 
Language (HTML), Flash or Word formatted document for access by the user or another user 
accessing the composite electronic document. 

2. (Previously Presented) The method of claim 1 , further comprising 
determining association information for the recorded information that corresponds to the 
extracted feature. 

3. (Original) The method of claim 2, wherein the association information 
comprises time information and source information for recorded information. 

4. (Previously Presented) The method of claim 2, further comprising 
associating the association information with the determined additional information in the 
composite electronic representation. 

5. (Previously Presented) The method of claim 4, further comprising: 
receiving a selection of the determined additional information in the composite 

electronic representation; and 

using the association information for the determined additional information to 
access the recorded information. 

6. (Previously Presented) The method of claim 1, further comprising 
accessing the recorded information using the determined additional information. 

7. (Original) The method of claim 6, further comprising displaying the 
accessed recorded information. 

8. (Original) The method of claim 7, further comprising playing the accessed 

information. 
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9. (Previously Presented) The method of claim 1 , further comprising: 
performing at least one of emailing, printing, storing, and copying the created 

composite electronic representation. 

10. (Canceled). 

1 1 . (Original) The method of claim 1, wherein the received electronic 
representation of the paper document includes notes taken by a user, wherein the created 
composite electronic representation includes the notes taken by the user. 

12. (Canceled). 

13. (Previously Presented) The method of claim 1, further comprising 
determining a document that includes the recorded information using the extracted feature. 

14. (Previously Presented) The method of claim 13, further comprising 
determining a portion of the document that includes the information corresponding to the feature. 

15. (Previously Presented) The method of claim 1 , wherein the feature 
comprises an identifier to a location in the recorded information, wherein the information in the 
recorded information corresponding to the feature is determined using the identifier. 

1 6. (Original) The method of claim 15, wherein the identifier comprises at 
least one of a barcode and signature information. 

17. (Previously Presented) The method of claim 1, wherein receiving the 
electronic representation comprises receiving a scan of the document, the document being a 
paper document. 

1 8. (Previously Presented) The method of claim 1, wherein receiving the 
electronic representation comprises determining an electronic image of the document, the 
document being a paper document. 
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19. (Original) The method of claim 1, wherein receiving the electronic 
representation comprises receiving the electronic representation in response to an input from a 
user indicating that the composite electronic representation should be created. 

20. (Original) The method of claim 1 , wherein the document comprises a 
paper document. 

21 . (Previously Presented) A method in a computer system for creating a 
composite electronic representation of a document using information recorded during a 
presentation, the method comprising: 

scanning a paper document to generate an electronic representation of the 
document for the presentation, the electronic representation including a visual feature that was 
presented during the presentation; 

extracting the visual feature from the electronic representation; 

accessing recorded information including at least one of audio and visual 
information recorded during the presentation, and using a matching algorithm to compare the 
visual feature to the recorded information to determine a portion of the recorded information that 
matches the visual feature, the matching algorithm configured to map the visual feature to a 
portion of any of a plurality of recorded information that matches the feature portion and 
generate matching information in response thereto; 

generating composite information based on the portion of the recorded 
information that corresponds to the visual feature and the electronic representation of the 
document; 

generating a user selectable object providing a user with access to the portion of 
the recorded information corresponding to the visual feature, and inserting the user selectable 
object and metadata including the matching information into the electronic representation of the 
document when the computer system locates a portion of the recorded information corresponding 
to the visual feature, the computer system thus creating a composite electronic representation of 
the document including the user selectable object and the metadata, the user selectable object 
being placed in a position associated with the extracted feature and allowing the user to access 



Page 5 of 21 



Appl. No. 10/813,901 

Amdt. dated November 4, 2009 

Reply to Office Action of August 4, 2009 



PATENT 



the composite information in an application displaying the composite electronic representation or 
a separate application by selecting the user selectable object, the user-selectable object being able 
to access the portion of the recorded information using an embedded video link in the user 
selectable object; and 

storing the composite electronic representation as a PDF, HyperText Transfer 
Language (HTML), Flash or Word formatted document for access by the user or another user 
accessing the composite electronic document. 

22. (Previously Presented) The method of claim 2 1 , further comprising 
determining association information for the recorded information that corresponds to the feature. 

23. (Previously Presented) The method of claim 22, wherein the association 
information comprises time information for the recorded information, the time information 
indicating a time when information related to the feature was presented during the presentation. 

24. (Previously Presented) The method of claim 23, further comprising: 
using the association information for the determined information in the composite 

electronic representation to access recorded information for the presentation at a time indicated 
by the time information. 

25 . (Previously Presented) The method of claim 2 1 , further comprising 
accessing recorded information using the determined composite information. 

26. (Original) The method of claim 25, further comprising displaying the 
accessed recorded information. 

27. (Original) The method of claim 26, further comprising playing the 
accessed information. 

28. (Canceled). 



Page 6 of 21 



Appl. No. 10/813,901 PATENT 

Amdt. dated November 4, 2009 

Reply to Office Action of August 4, 2009 

29. (Previously Presented) The method of claim 21, further comprising 
performing at least one of emailing, printing, storing, and copying the created composite 
electronic representation. 

30. (Original) The method of claim 21, wherein the document comprises a 
paper document. 

3 1 . (Previously Presented) The method of claim 2 1 , wherein the feature 
comprises an identifier to a location in the recorded information, wherein the information in the 
recorded information that corresponds to the feature is determined using the identifier. 

32. (Original) The method of claim 31, wherein the identifier comprises at 
least one of a barcode and signature information. 

33. (Original) The method of claim 21, wherein receiving the electronic 
representation comprises receiving the electronic representation in response to an input from a 
user indicating that the composite electronic representation should be created. 

34. (Previously Presented) A computer program product stored on a 
computer-readable medium for creating a composite electronic representation, the computer 
program product comprising: 

code for scanning a paper document to generate an electronic representation of the 
document, the document including presentation material; 

code for extracting a visual feature from the electronic representation of the 
document, the visual feature corresponding to at least a portion of the presentation material; 

code for accessing recorded information including at least one of audio and visual 
information recorded during a presentation of the presentation material, and comparing the visual 
feature to the recorded information to determine a portion of the recorded information that 
matches the visual feature, whereby at least a portion of the recorded information matches a 
feature portion of the presentation material, and determining matching information for each 
matching portion of the recorded information and feature portion using a matching algorithm 
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configured to map the visual feature to a portion of any of a plurality of recorded information 
that matches the feature portion; 

code for generating a user selectable object providing a user with access to the 
portion of the recorded information determined to match the visual feature, and inserting the user 
selectable object and metadata including the matching information into the electronic 
representation of the document when the computer system locates a portion of the recorded 
information corresponding to the visual feature, the computer system thus creating a composite 
electronic representation of the document including the user selectable object, the user selectable 
object being placed in a position associated with the extracted feature and allowing the user to 
access the portion of the recorded information in an application displaying the composite 
electronic representation or a separate application by selecting the user selectable object, the 
user-selectable object being able to access the portion of the recorded information using an 
embedded video link in the user selectable object; and 

code for storing the composite electronic representation as a PDF, HyperText 
Transfer Language (HTML), Flash or Word formatted document for access by the user or 
another user accessing the composite electronic document. 

35. (Previously Presented) The computer program product of claim 34, further 
comprising code for determining association information for the recorded information that 
corresponds to the extracted feature. 

36. (Previously Presented) The computer program product of claim 35, further 
comprising code for associating the association information with the determined additional 
information in the composite electronic representation. 

37. (Previously Presented) The computer program product of claim 36, further 

comprising: 

code for receiving a selection of the determined additional information in the 
composite electronic representation; and 
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code for using the association information for the determined additional 
information to access the recorded information. 

38. (Previously Presented) The computer program product of claim 34, further 
comprising code for accessing the recorded information using the determined additional 
information. 

39. (Previously Presented) The computer program product of claim 34, further 

comprising: 

code for performing at least one of emailing, printing, storing, displaying, playing, 
and copying the created composite electronic representation. 

40. (Canceled). 

4 1 . (Previously Presented) The computer program product of claim 34, 
wherein the received electronic representation of the document includes notes taken by a user, 
wherein the created composite electronic representation includes the notes taken by the user. 

42. (Previously Presented) The computer program product of claim 34, 
wherein the feature comprises an identifier to a location in the recorded information, wherein the 
information in the recorded information that corresponds to the feature is determined using the 
identifier. 

43. (Original) The computer program product of claim 34, wherein the 
document comprises a paper document. 

44. (Previously Presented) A computer program product stored on a 
computer-readable medium for creating a composite electronic representation of a document 
using information recorded during a presentation, the computer program product comprising: 

code for scanning a paper document to generate an electronic representation of the 
document for the presentation, the electronic representation including a visual feature that was 
presented during the presentation; 
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code for extracting the visual feature from the electronic representation; 

code for accessing recorded information including at least one of audio and visual 
information recorded during the presentation, and using a matching algorithm to compare the 
visual feature to the recorded information to determine a portion of the recorded information that 
matches the visual feature, the matching algorithm configured to map the visual feature to a 
portion of any of a plurality of recorded information that matches the feature portion and 
generate matching information in response thereto; 

code for generating composite information based on the portion of the recorded 
information that corresponds to the visual feature and the electronic representation of the 
document; 

code for generating a user selectable object providing a user with access to the 
portion of the recorded information corresponding to the visual feature, and inserting the user 
selectable object and metadata including the matching information into the electronic 
representation of the document when the computer system locates a portion of the recorded 
information corresponding to the visual feature, the computer system thus creating a composite 
electronic representation of the document including the user selectable object and the metadata, 
the user selectable object being placed in a position associated with the extracted feature and 
allowing the user to access the composite information in an application displaying the composite 
electronic representation or a separate application by selecting the user selectable object, the 
user-selectable object being able to access the portion of the recorded information using an 
embedded video link in the user selectable object; and 

code for storing the composite electronic representation as a PDF, HyperText 
Transfer Language (HTML), Flash or Word formatted document for access by the user or 
another user accessing the composite electronic document. 

45. (Previously Presented) The computer program product of claim 44, further 
comprising code for determining association information for the recorded information that 
corresponds to the feature. 
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46. (Previously Presented) The computer program product of claim 45, 
wherein the association information comprises time information for recorded information, the 
time information indicating a time when information related to the feature was presented during 
the presentation. 

47. (Previously Presented) The computer program product of claim 46, further 

comprising: 

code for using the association information for the determined composite 
information in the composite electronic representation to access recorded information for the 
presentation at a time indicated by the time information. 

48. (Canceled). 

49. (Previously Presented) The computer program product of claim 44, 
further comprising code for performing at least one of emailing, printing, storing, displaying, 
playing, and copying the created representation. 

50. (Original) The computer program product of claim 44, wherein the 
document comprises a paper document. 

5 1 . (Previously Presented) A data processing system for creating a composite 
electronic representation, the data processing system comprising: 

a processor; 

a memory coupled to the processor, the memory configured to store a plurality of 
modules for execution by the processor, the plurality of modules comprising: 

logic to scan a paper document to generate an electronic representation of the 
document, the document including presentation material; 

logic to extract a visual feature from the electronic representation of the 
document, the visual feature corresponding to at least a portion of the presentation material; 

logic to access recorded information including at least one of audio and visual 
information recorded during a presentation of the presentation material, and compare the visual 
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feature to the recorded information to determine a portion of the recorded information that 
matches the visual feature, whereby at least a portion of the recorded information matches a 
feature portion of the presentation material, and determining matching information for each 
matching portion of the recorded information and feature portion using a matching algorithm 
configured to map the visual feature to a portion of any of a plurality of recorded information 
that matches the feature portion; 

logic to generate a user selectable object providing a user with access to the 
portion of the recorded information corresponding to determined to match the visual feature, and 
inserting the user selectable object and metadata including the matching information into the 
electronic representation of the document when the computer system locates a portion of the 
recorded information corresponding to the visual feature, the computer system thus creating a 
composite electronic representation of the document including the user selectable object, the user 
selectable object being placed in a position associated with the extracted feature and allowing the 
user to access the portion of the recorded information in an application displaying the composite 
electronic representation or a separate application by selecting the user selectable object, the 
user-selectable object being able to access the portion of the recorded information using an 
embedded video link in the user selectable object; and 

logic to store the composite electronic representation as a PDF, HyperText 
Transfer Language (HTML), Flash or Word formatted document for access by the user or 
another user accessing the composite electronic document. 

52. (Previously Presented) The data processing system of claim 5 1 , further 
comprising logic to determine association information for the recorded information that 
corresponds to the extracted feature. 

53. (Previously Presented) The data processing system of claim 52, further 
comprising logic to associate the association information with the determined additional 
information in the composite electronic representation. 
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54. (Previously Presented) The data processing system of claim 53, further 

comprising: 

logic to receive a selection of the determined additional information in the 
composite electronic representation; and 

logic to use the association information for the determined information to access 
the recorded information. 

55. (Previously Presented) The data processing system of claim 5 1 , further 
comprising logic to access recorded information using the determined additional information. 

56. (Previously Presented) The data processing system of claim 5 1 , further 

comprising: 

logic to perform at least one of emailing, printing, storing, displaying, playing, 
and copying the created composite electronic representation. 

57. (Canceled). 

58. (Previously Presented) The data processing system of claim 5 1 , wherein 
the received electronic representation includes notes taken by a user, wherein the created 
composite electronic representation includes the notes taken by the user. 

59. (Previously Presented) The data processing system of claim 5 1 , wherein 
the feature comprises an identifier to a location in the recorded information, wherein the 
information in the recorded information that corresponds to the feature is determined using the 
identifier. 

60. (Original) The data processing system of claim 5 1 , wherein the document 
comprises a paper document. 

61 . (Previously Presented) A data processing system creating a composite 
electronic representation of a document using information recorded during a presentation, the 
data processing system comprising: 
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a processor; 

a memory coupled to the processor, the memory configured to store a plurality of 
modules for execution by the processor, the plurality of modules comprising: 

logic to scan a paper document to generate an electronic representation of the 
document for the presentation, the electronic representation including a visual feature that was 
presented during the presentation; 

logic to extract the visual feature from the electronic representation; 

logic to access recorded information including at least one of audio and visual 
information recorded during the presentation, and using a matching algorithm to compare the 
visual feature to the recorded information to determine a portion of the recorded information that 
matches the visual feature, the matching algorithm configured to map the visual feature to a 
portion of any of a plurality of recorded information that matches the feature portion and 
generate matching information in response thereto; 

logic to generate composite information based on the portion of the recorded 
information that corresponds to the visual feature and the electronic representation of the 
document; 

logic to generate a user selectable object providing a user with access to the 
portion of the recorded information corresponding to the visual feature, and inserting the user 
selectable object and metadata including the matching information into the electronic 
representation of the document when the computer system locates a portion of the recorded 
information corresponding to the visual feature, the computer system thus creating a composite 
electronic representation of the document including the user selectable object and the metadata, 
the user selectable object being placed in a position associated with the extracted feature and 
allowing the user to access the composite information in an application displaying the composite 
electronic representation or a separate application by selecting the user selectable object, the 
user-selectable object being able to access the portion of the recorded information using an 
embedded video link in the user selectable object; and 



Page 14 of 21 



Appl.No. 10/813,901 

Amdt. dated November 4, 2009 

Reply to Office Action of August 4, 2009 



PATENT 



logic to store the composite electronic representation as a PDF, HyperText 
Transfer Language (HTML), Flash or Word formatted document for access by the user or 
another user accessing the composite electronic document. 

62. (Previously Presented) The data processing system of claim 6 1 , further 
comprising logic to determine association information for the recorded information that 
corresponds to the feature. 

63. (Previously Presented) The data processing system of claim 62, wherein 
the association information comprises time information for recorded information, the time 
information indicating a time when information related to the feature was presented during the 
presentation. 

64. (Previously Presented) The data processing system of claim 63, further 

comprising: 

logic to use the association information for the determined composite information 
in the composite electronic representation to access the recorded information for the presentation 
at a time indicated by the time information. 

65. (Canceled). 

66. (Previously Presented) The data processing system of claim 61, further 
comprising logic to perform at least one of emailing, printing, storing, displaying, playing, and 
copying the created representation. 

67. (Original) The data processing system of claim 61 , wherein the document 
comprises a paper document. 

68. (Previously Presented) A system for creating a composite electronic 
representation, the method comprising: 

means for scanning a paper document to generate an electronic representation of 
the document, the document including presentation material; 
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means for extracting a visual feature from the electronic representation of the 
document, the visual feature corresponding to at least a portion of the presentation material; 

means for accessing recorded information including at least one of audio and 
visual information recorded during a presentation of the presentation material, and comparing the 
visual feature to the recorded information to determine a portion of the recorded information that 
matches the visual feature, whereby at least a portion of the recorded information matches a 
feature portion of the presentation material, and determining matching information for each 
matching portion of the recorded information and feature portion using a matching algorithm 
configured to map the visual feature to a portion of any of a plurality of recorded information 
that matches the feature portion; 

means for generating a user selectable object providing a user with access to the 
portion of the recorded information determined to match the visual feature, and inserting the user 
selectable object and metadata including the matching information into the electronic 
representation of the document when the computer system locates a portion of the recorded 
information corresponding to the visual feature, the computer system thus creating a composite 
electronic representation of the document including the user selectable object, the user selectable 
object being placed in a position associated with the extracted feature and allowing the user to 
access the portion of the recorded information in an application displaying the composite 
electronic representation or a separate application by selecting the user selectable object, the 
user-selectable object being able to access the portion of the recorded information using an 
embedded video link in the user selectable object; and 

means for storing the composite electronic representation as a PDF, HyperText 
Transfer Language (HTML), Flash or Word formatted document for access by the user or 
another user accessing the composite electronic document. 

69. (Previously Presented) A system for creating a composite electronic 
representation of a document using information recorded during a presentation, the method 
comprising: 
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means for scanning a paper document to generate an electronic representation of 
the document for the presentation, the electronic representation including a visual feature that 
was presented during the presentation; 

means for extracting the visual feature from the electronic representation; 

means for accessing recorded information including at least one of audio and 
visual information recorded during the presentation, and using a matching algorithm to compare 
the visual feature to the recorded information to determine a portion of the recorded information 
that matches the visual feature, the matching algorithm configured to map the visual feature to a 
portion of any of a plurality of recorded information that matches the feature portion and 
generate matching information in response thereto; 

means for generating composite information based on the portion of the recorded 
information that corresponds to the visual feature and the electronic representation of the 
document; 

means for generating a user selectable object providing a user with access to the 
portion of the recorded information corresponding to the visual feature, and inserting the user 
selectable object and metadata including the matching information into the electronic 
representation of the document when the computer system locates a portion of the recorded 
information corresponding to the visual feature, the computer system thus creating a composite 
electronic representation of the document including the user selectable object and the metadata, 
the user selectable object being placed in a position associated with the extracted feature and 
allowing the user to access the composite information in an application displaying the composite 
electronic representation or a separate application by selecting the user selectable object, the 
user-selectable object being able to access the portion of the recorded information using an 
embedded video link in the user selectable object; and 

means for storing the composite electronic representation as a PDF, HyperText 
Transfer Language (HTML), Flash or Word formatted document for access by the user or 
another user accessing the composite electronic document. 
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